Papers with DPO baseline of 4.6
Reverse Preference Optimization for Complex Instruction Following (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for identifying and evaluating preference pairs with multiple constraints are noisy. |
| Approach: | They propose a method that dynamically reverses constraints to ensure the chosen response is perfect. |
| Outcome: | The proposed method reduces noise in preference pairs by reversing constraints to ensure the chosen response is perfect. |